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Abstract 

Results of product assessments are often criticised as to their 
handling of uncertainty. Therefore, it is necessary to develop a 
comprehensive methodology reflecting parameter uncertainty 
in combination with uncertainty due to choices in the outcome 
of I.CAs. This paper operationalises the effect of combined pa¬ 
rameter uncertainties in the inventory and in the characterisa¬ 
tion factors for global warming and acidification for the com¬ 
parison of two exemplary types of roof gutters. For this purpose, 
Latin Hypercube sampling is used in the matrix (inventory) 
method. To illustrate the influence of choices, the effect on LCA 
outcomes is shown of two different allocation procedures in 
open-loop recycling and three time horizons for global warm¬ 
ing potentials. Furthermore, an uncertainty importance analy¬ 
sis is performed to show which parameter uncertainties mainly 
contribute to uncertainties in the comparison and the separate 
environmental profiles of the product systems. These results can 
be used to prioritise further data research. 


Keywords: Allocation rules, parameter uncertainty, LCA; Latin 
hypercube simulation, parameter uncertainty, LCA; LCA, pa¬ 
rameter uncertainty; Life Cycle Assessment, parameter uncer¬ 
tainty; open-loop recycling, parameter uncertainty, LCA; param¬ 
eter uncertainty, LCA; probabalistic simulation, parameter 
uncertainty, LCA; scenario analysis, parameter uncertainty, LCA; 
simulation, Latin hypercube simulation, parameter uncertainty, 
LCA; simulation, probabalistic simulation, parameter uncer¬ 
tainty, LCA; uncertainty, LCA; variability, parameter 


1 Introduction 

The ultimate goal of environmental life cycle assessments 
(LCAs) is to provide information for decisions which will 
lead to environmental improvement of economies. However, 
LCAs may give rise to incorrect decisions when uncertainty 
and variability are not properly taken into account. Although 


at present model uncertainties due to the lack of spatial vari¬ 
ability and temporal variability in the assessment generally 
cannot be made operational in LCA case studies, other types 
of uncertainty, such as parameter uncertainty and uncertainty 
due to choices, potentially can (HuijBRKcrrs, 1998). 

To illustrate parameter uncertainty and uncertainty due to 
choices, this paper compares two types of roof gutters with 
respect to their potential contribution to the environmental 
categories global warming (time horizon 20, 100 and 500 
years) and acidification, using simplified inventory data. 
Using probabilistic modelling and scenario analysis, it shows 
the influence on LCA model outcomes of parameter uncer¬ 
tainties, of the choice of different allocation rules applied to 
open-loop recycling processes, and of different time hori¬ 
zons for global warming potentials. Furthermore, it couples 
the uncertainty analysis with an uncertainty importance 
analysis, which verifies the parameters that introduce the 
largest uncertainty in model outcomes. Finally, it discusses 
the feasibility of the application of this methodology in "real- 
life" LCAs and possibilities for simplifying the analysis. These 
studies may help in developing a comprehensive methodol¬ 
ogy for the inclusion of parameter uncertainty and uncer¬ 
tainty due to choices in LCA studies. 

2 Data Input 

2.1 Inventory 

The matrix method, developed by Heijungs (1994,1996), is 
used to perform the inventory analysis. The inventory table 
I is computed with the following formula (Heijungs, 1996): 

I = HxG~'xu (1) 

where: 


Int. J. LCA 3 (6) 343-351 (1998) 

© ecoined publishers, D-86899 Landsberg, Germany 


343 








Uncertainty in LCA 


LCA Methodology 


I = Inventory table; 

H = Environmental intervention matrix; 

G = Technology matrix; 

u = External supply vector, related to the functional unit. 

An important advantage of the matrix method over other 
inventory methods is that the method easily deals with self- 
referring groups of processes (Heijungs, 1994). The matrix 
method has already been used for extensive life cycle inven¬ 
tories, such as the inventories for energy systems (Frisch- 
knecht et ah, 1 996). 

The functional unit used in the comparison of roof gutters 
A1 and A2 is "the discharge of rain water falling on the roof 
of a one-family building during fifty years". The application 
of 10 m of roof gutter fulfils this function for about 25 years. 
It is expected that part of both types of roof gutters will be 
recycled in the product system "Sewage pipes". The cut-off 
method and the avoided-impacts method are used to allo¬ 
cate the environmental burdens associated with the recy¬ 
cling of the products. These methods reflect two extreme 
visions on how to allocate environmental burdens in open- 
loop recycling processes and both were judged defensible by 
experts (Kortman et ah, 1996). The cut-off method allo¬ 
cates the environmental interventions caused by the waste 
recycling process to the receiving product system S, while 
the avoided-impacts method allocates the environmental 
interventions caused by the waste recycling process to the 
product system Ax, but also credits system Ax by substracting 


the avoided environmental interventions from the original 
inventory table of Ax. The inventory data of the two roof 
gutter systems are given in Tables 1 through 3. 

Parameter uncertainty in the inventory analysis of the two 
product systems is characterised with the help of "Uncer¬ 
tainty factors (UFs)" which are given in the Tables 3 and 4. 
UFs are used to represent inventory data uncertainties as a 
triangular uncertainty distribution. The minimum and maxi¬ 
mum values 1 of parameter P, are assumed to be: 


r x, min 

and 


modus 


UF X 


( 2 ) 


P - P , V IIF 
Lr.max 1 x. modus ^ .v 

where: 


(3) 


P x = Minimum value of parameter x; 

P . = Most likely value of parameter x; 

P = Maximum value of parameter x; 

x, max 1 

UF x = Uncertainty factor applied to parameter x; 


1 When P s ^ < 0, P t inJ( and P, mm change places in the formulas 


Table 1: Inventory data of product system "Roof gutter A1" 


Process 

Commodity 

Electricity 

production 

Oil 

production 

Plastic PI 
production 

Gutter A1 
production 

Gutter A1 
use and 
demolition 

Incineration 

of P1/A1 

Recycling 

process' 

Material B 
production" 

Product 

system 

MJ electricity 

1 

-1.10** 

-50 

-1 

0 

-1 

-25 

40 

0 

kg oil 

-6.1 O' 3 

1 

-0.8 

0 

0 

-0.5 

-0.1 

0.3 

0 

kg plastic PI 

0 

0 

1 

-325 

0 

0 

0 

0 

0 

100 m produced A1 

0 

0 

0 

1 

-1 

0 

0 

0 

0 

100 m installed A1 

0 

0 

0 

0 

1 

0 

0 

0 

0.2' 

kg incinerated P1/A1 

0 

0 

-0.01* 

-0.05* 

CO 

CD 

1 

-0.T 

0 

0 

kg A1 in recycling 

0 

0 

0 

0 

-260*° 

0 

1 

0 

0 

kg avoided material B 

0 

0 

0 

0 

0 

0 

-1.8*' 3 

1 

0 

kg C0 2 

1.10' 2 

0.5 

2 

0 

0 

3 

2 

-1.5 


kg CH„ 

3.1 O' 4 

4.1 O' 3 

0 

0 

0 

5.1 O' 5 

4.i o -3 

0 


kg N 2 0 

1 .10 6 

1.10' 44 

1.10 s 

0 

0 

5.10 s 

3.10* 

-2.10- 


kg NO, 

3.1 O’ 4 

2.10' 3 

5.1 O' 3 

0 

0 

8.10- 

2.10' 3 

-4.1 O' 3 


kg SO z 

6.10" 

3.1 O’ 3 

0.1 

0 

0 

2.10' 4 

1.10 2 

-5.1 O' 3 



a in addition to economic inflows economic outflows have a negative sign in the technology matrix; °the amount of "kg A1 to the recycling process" is 
computed by multiplying "kg plastic PI" used in the production of 100 m of roof gutter A1 with the “recycling fraction of roof gutter A1“. The computation of 
the amount of waste to the incineration process is done in the same way, but "1 - recycling fraction" is used in the multiplication; c the process data of the 
recycling process and Material B production are only used if the avoided-impacts allocation method is applied; fl the amount of avoided materia! B per kg 
A1 going into the recycling process is computed by multiplying "the amount of A1 going to product system S" with the ratio of the mass of material B1 and 
the mass of product A1 related to the functional unit of the receiving product system S; “the signs of the economic process data and the environmental 
interventions per kg material B are reversed, because the avoided-impacts allocation method substracts the environmental inventions related to the 
amount of avoided material B from original product system A1; 'The fraction of 100 m roof gutter needed to fulfil the functional unit is computed by 
multiplying ‘the fraction of 100m of roof gutter, initially applied to a one-family house" with 50 years, divided by the expected lifetime of the roof gutter. 
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Table 2: Inventory data of product system "Roof gutter A2" 


Process 

Commodity 

Electricity 

production 

Oil 

production 

Plastic P2 
production 

Gutter A2 
production 

Gutter A2 
use and 
demolition 

Incineration 

01P2/A2 

Recycling 

process' 

Material B i 
production” 

Product 

system 

MJ electricity 

1 

-1.10’ 

-40 

-2 

0 

-1 

-40 

40 

0 

kg oil 

-6.10' 3 

1 

-0.6 

0 

0 

-0.5 

-0.5 

0.3 

0 

kg plastic P2 

0 

0 

1 

-200 

0 

0 

0 

0 

0 

100 m produced A2 

0 

0 

0 

1 

-1 

0 

0 

0 

0 

100 m installed A2 

0 

0 

0 

0 

1 

0 

0 

0 

0.2' 

kg incinerated P2/A2 

0 

0 

-0.02* 

-0.05* 

-20* b 

1 

-0.2* 

0 

0 

kg A2 in recycling 

0 

0 

0 

0 

-180*° 

0 

1 

0 

0 

kg avoided material B 

0 

0 

0 

0 

0 

0 


1 

0 

kg CO, 

1.10’ 

0.5 

1.5 

0 

0 

2 

2.5 

-1.5 


kg CH 4 

3.1 O'" 

4.10' 3 

0 

0 

0 

3.10' 5 

2.1 O' 3 

0 


kg N 2 0 

1.1 0 6 

1.10“ 

3.10“ 

0 

0 

6.10 s 

4.10“ 

-2.10“ 


kg NO„ 

3.10“ 

2.10 3 

0.5 

0 

0 

6.10“ 

3.10’ 

-4.10 3 


kg S0 2 

6.10“ 

3.10 3 

1.10’ 

0 

0 

4.10“ 

2.10’ 

-5.10' 3 



same comments as in Table 1 


Table 3: Additional input data and uncertainty factors applied to the product systems A1 and A2 


Parameters 

Product sytem Al 

Product system A2 

UF" 

Recycling fraction Ax 

0.80 

0.90 

1.1 

Mass of product Ax related to the functional unit of the 
receiving product system S 

250 

200 

1.1 

Mass of material B related to functional unit of the receiving 
product system S“ 

500 

500 

1.1 

Fraction of 100 m roof gutter, initially applied to a one-family 
house* 

0.1 

0.1 

1.05 

Lifetime of roof gutter Al and A2 (years)* 

25 

25 

1.25 

* it is assumed that these parameters are not product system specific; “ UF = 

uncertainty factor 




By way of simplification, estimates of the UFs and the ap¬ 
plied distribution form are entirely arbitrary. Furthermore, 
the UFs for the product-specific process data in the two prod¬ 
uct systems are assumed to be the same, which would not be 
necessarily true in "real life" cases. 

2.2 Global Warming 

The Global Warming Potential (GWP) of a gas is "the cu¬ 
mulative radiative forcing between the present and some 
chosen later time "horizon" caused by a unit mass of gas 
emitted now, expressed relative to some reference gas” 
(Albritton et al., 1996). Generally, C0 2 is taken as the ref¬ 
erence gas. As a consequence, the uncertainty of the GWP 
of any trace gas other than C0 2 depends upon the substance- 
specific uncertainties in the integrated radiative forcing (IF) 
of the gas itself and on the IF of C0 2 (Albritton et al., 
1995, 1996). 

A typical uncertainty in the direct IF of various gases, such 
as N,0, is estimated to be ± 35%, caused by uncertainties 


in the parameters "radiative forcing per molecule" and "life¬ 
times in the atmosphere of the trace gases" (Albritton et 
al., 1995, 1996). Because a further explanation of the un¬ 
certainty distribution is lacking in the IPCC reports, it is 
assumed in this assessment that the ± 35% uncertainty rep¬ 
resents the 95% confidence range of a normal uncertainty 
distribution (—> Table 5). In addition to the direct radiative 
forcing capacity, the IF of CH 4 depends on indirect contri¬ 
butions to the radiative forcing of CH 4 due to stratospheric 
ozone and water vapour production. Uncertainty ranges for 
the IF of CH 4 for the time horizons 20, 100 and 500 years, 
given by Albritton et al. (1995), are in the same order as 
the above-mentioned ±35% uncertainty range. Uncertain¬ 
ties in the IF for C0 2 depend on uncertainties in the carbon 
cycle. The effect of these uncertainties is not known, be¬ 
cause of the large model uncertainties involved (Albritton 
et al., 1995). As a result, it is impossible to quantify the 
uncertainties in probabilistic simulation. 

Variation in future scenarios of CO, and other trace gas 
emissions also have an effect on GWP-values, although the 
IF of C0 2 is relatively insensitive to these emission scenarios 
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Tabic 4 : Uncertainty factors applied to the inventory data of the product systems A1 and A2 


Process 

Commodity 

Electricity 

production 

Oil 

production 

Plastic 

production 

Gutter 

production 

Gutter use 
and 

demolition 

Incineration 
of waste 

Recycling 

process 

Material B 
production 

Product 

system 

MJ electricity 

1,01 

1.1 

1.05 

1.05 

1 

1.1 

1.05 

1.1 

1 

kg oil 

1.05 

1.01 

1.05 

1 

1 

1.1 

1.05 

1.1 

1 

kg plastic 

1 

1 

1.01 

1.05 

1 

1 

1 

1 

1 

100 m produced 
gutter 

1 

1 

1 

1.01 

1 

1 

1 

1 

1 

100 m installed gutter 

1 

1 

1 

1 

1 

1 

1 

1 

n.a. a 

kg incinerated waste 

1 

1 

1.2 

1.1 

n.a. a 

1.01 

1.05 

1 

i 

kg gutter in recycling 

1 

1 

1 

1 

n.a. a 

1 

1.01 

1 

i 

kg avoided material B 

1 

1 

1 

1 

i 

1 

n.a. 3 

1.01 

i 

kg CO, 

1.1 

1.1 

1.05 

1 

i 

1.05 

1.05 

1.05 


kg CH, 

2 

2 

1 

1 

i 

2 

1.1 

1 


kg N,0 

5 

5 

3 

1 

i 

5 

3 

4 


kg NO, 

1.5 

1.5 

1.1 

1 

i 

1.5 

1.1 

1.2 


kg SO,, 

1.5 

1.5 

1.1 

1 

i 

1.5 

1.1 

1.2 



' n.a. = not applicable: uncertainty factors are only applied to input data and not applied to computation outcomes 


(Cai.dkira 8c Kastinc, 1993; Albritton et ai., 1995). When 
two very different extreme scenarios are compared with the 
reference scenario, a maximum difference of ± 15% in GWP- 
values is found (Albritton et al., 1995). The choice of a 
reference future atmosphere for a GWP is not a parameter 
uncertainty, but rather an agreement upon a selection of a 
future scenario for atmospheric composition, and therefore 
it causes uncertainty due to choices. This uncertainty is not 
taken into account in the further assessment here. Nor are 
other uncertainties and limitations of GWPs quantified. For 
instance, the GWP concept is not applicable to gases and 
aerosols that are very unevenly distributed. For this reason, 
GWPs for sulphur oxides, which probably contribute to nega¬ 
tive radiative forcing through aerosol, and NO s are not esti¬ 
mated by Albritton et al. (1995,1996). 

2.3 Acidification 

Heijungs et al. (1992) proposed an "acid equivalents ap¬ 
proach" in the computation of the Acidification Factor (AF) 
of a substance, in which the proton release per kg emission 
of the substance in the environment is divided by the proton 


release per kg emission of a reference substance, assuming 
that emitted substances are fully transformed into protons. 
Realization of the maximum proton release depends on 
whether or not the anions which accompany the released 
protons are completely leached out of the system. The con¬ 
tribution to acidification is reduced when the anions are 
bound in the soil or removed in biomass (Hauschii.i) 8c 
Wenzel, 1998). When SO, is taken as the reference sub¬ 
stance, the AF of an acidifying substance is caused by the 
uncertainty in the proton release of SO, and the proton re¬ 
lease of the substance itself. 

For SO, emissions the average release of approximately two 
protons is thought to be representative for terrestrial condi¬ 
tions, because the soil retention of SO, 2 ' and S0 4 2 ions, 
formed by deposition of SO,, is considered to be small 
(Finnveden et al., 1992; Hauschild & Wenzel, 1998). In this 
assessment a relatively small uncertainty range for average 
proton release due to SO, emissions is considered (—a Table 5). 
For NO n emissions, the actual proton release is more com¬ 
plicated to derive. The first problem may be that NO and 
NO, emissions are taken together as NO x which may cause 
uncertainty in the value of x. NO, however, is measured and 


Table 5: Characteristics of the Global Warming Potentials (20, 100 and 500 years time horizon) and Acidification Factors for the emis¬ 
sions considered in this example 



Units 

o 

o 

CH, 

mean (sd) ■ 

n 2 o 

mean (sd) 

NO, 

[min - max] 

SO, 

[min - max] 

UD a 

GWP20 

CO,-eq. (kg) 

1 

56 (9.8) 

280 (49.0) 

? 

7 

normal 

GWP100 

CO,-eq. (kg) 

1 

21 (3.7) 

310(54.3) 

? 

? 

normal 

GWP500 

CO,-eq. (kg) 

1 

6.5 (1.1) 

170 (29.8) 

? 

? 

normal 

Proton release 

- 

? 

0 

0 

[0.5 - 0.9] 

[1.9 - 2.0] 

Uniform 

a UD » uncertainty distribution 
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represented as NO, in NO s inventories. Thus, x has a value 
of 2 which is in line with Hauschild & Wenzei. (1998) and 
Heijungs et al. (1992). Furthermore, it is unclear what aver¬ 
age fraction of NO, ions, following from the deposition of 
nitrogen oxides, is taken up by plants and removed from the 
system. As a first approximation, the minimum and maxi¬ 
mum values for average removal of NO,' ions due to har¬ 
vesting are chosen to be respectively 10% and 50%, result¬ 
ing in a net release of protons of 50% to 90% of the 
theoretical maximum (—> Table 5). 

3 Environmental Profiles 

To show the effect on LCA outcomes of uncertainty in the 
input data, Latin Hypercube simulation is performed with 
Crystal Ball (Decisioneering, 1996) in the spreadsheet pro¬ 
gram Microsoft Excel 7.0 (Microsoft, 1995). This method 
segments the uncertainty distribution of a parameter into a 
number of non-overlapping intervals, each having equal 
probability. In addition, a value from each interval is ran¬ 
domly selected according to the probability distribution 
within the interval. The randomly selected values from all 
the parameter uncertainty distributions are inserted in the 
output equation. Repeated calculations produce a distribu¬ 
tion of the predicted output values, reflecting the combined 
parameter uncertainties. Each model run consisted of 10,000 
iterations, which is considered sufficient to obtain a repre¬ 
sentative frequency chart of the output variables (Morgan 
&c Henrion, 1990). 


The quotients of product system Al and product system A2 
for their potential contribution to global warming and acidi¬ 
fication are computed with Equation 4 and used to indicate 
the significance of differences between the two product sys¬ 
tems. When a quotient is significantly lower than 1, product 
system Al contributes less to an environmental category than 
product system A2. When a quotient is significantly higher 
than 1, the reverse is true. A certain result is considered to 
be significant if 95% of the iterations lies above or below 1. 

x=n 

CF ex x Fai. v 

Cl e = - (4) 

CF e x x Fa2..i 

x=\ 

Cl = Comparison indicator for environmental category 
e (dimensionless); 

CF x = Characterisation factor of substance x in the envi¬ 
ronmental category e (dimensionless); 

E A| = Amount of emitted substance x related to product 
system Al (kg); 

E A , = Amount of emitted substance x related to product 
system A2 (kg); 

x = Emission identification number (dimensionless); 
n = Number of emission types (dimensionless). 

Figures 1 and 2 respectively show the frequency charts of 
the Global Warming Comparison Indicator with a chosen 
time horizon of 100 years (GWCI |00 ) and the Acidification 


n . ..... Cut-off allocation _. _ A voided-impacts _ 

Probability Frequency Probability Frequency 




„ . . .... Avoided-impacts allocation ___ 

Probability Frequency 



1.25 1.69 2.13 2.56 3.00 

GWCI 100 


Fig. 1: Frequency charts of the Global Warming Comparison Indi¬ 
cator (time horizon 100 years) after 10,000 model iterations, when 
using either the cut-off method (la) or the avoided-impacts method 
(lb) to allocate environmental burdens associated with the open- 
loop recycling process 


Probability 


Cut-off allocation 


Frequency 



0.60 0.78 0.95 1.13 1.30 AC1 


2b 


Fig. 2: Frequency charts of the Acidification Comparison Indicator 
after 10,000 model iterations, when using either the cut-off method 
(2a) or the avoided-impacts method (2a) to allocate environmental 
burdens associated with the open-loop recycling process 
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Tabic 6: Statistical characteristics of the potential contribution of product systems A1 and A2 respectively to Global Warming (time 
horizons 20, 100 and 500 years) and Acidification, and the Comparison Indicators for Global Warming (time horizons 20, 100 and 500 
years) and Acidification 



Units 

| Global warming 
(20y) 

Global warming 
(100y) 

Global warming 
(500y) 

Acidification 



C“ 

A b 

C* 

A" 

C‘ 

A° 

C a 

A" 

Product system Al 

Mean 

COj/SCL-eq 

304.7 

212.6 

258.4 

189.7 

236.6 

180.1 

11.0 

9.4 

Standard deviation 


38.1 

30.3 

27.9 

25.8 

24.6 

23.5 

1.2 

1.1 

Distribution'’ 


LN 

LN 

LN 

LN 

LN 

LN 

LN 

LN 

Product system A2 

COj/S0 2 -eq 









Mean 


137.8 

99.8 

115.9 

91.6 

103.1 

85.4 

11.9 

11.5 

Standard deviation 


17.9 

17.6 

12.9 

15.3 

11.0 

13.4 

2.1 

2.2 

Distribution" 


LN 

LN 

LN 

LN 

LN 

LN 

LN 

LN 

Comparison Indicator 

dimensionless 









Mean 


2.22 

2.13 

2.23 

2.10 

2.30 

2.16 



Standard deviation 


0.11 

0.28 

0.12 

0.30 

0.13 

0.32 



Modus 








0.85 

0.75 

Range 








[0.7-1.25] 

[0.6-1.15] 

Distribution" 


LN 

LN 

LN 

LN 

LN 

LN 

T 

T 

Percentage Al > A2 

dimensionless 

100% 

100% 

100% 

100% 

100% 

100% 

31.9% 

7.8% 


"C = Cut-off allocation method, ''A = Avoided-impacts allocation method: C LN = Lognormal, T= Triangular 


Comparison Indicator (ACI), when using either the cut-off 
method or the avoided-impacts method to allocate environ¬ 
mental burdens associated with the open-loop recycling proc¬ 
ess. Table 6 shows some statistical characteristics of the re¬ 
spective comparison indicators. This table also lists the 
statistics of the potential contribution to global warming 
and acidification of the two product systems A1 and A2. 
The results show that the GWCI, 00 lies 100% above 1 re¬ 
gardless of the allocation method used. The same is true for 
GWCI, 0 and GWCI, (K) (-» Table 6). The ACI lies 28.6% and 
6.9% above 1, when the cut-off and avoided-impacts allo¬ 
cation method are used, respectively. Thus, product system 
A2 contributes significantly less to global warming than prod¬ 
uct system Al; however, when considering the contribution 
to acidification using the above-mentioned criterion for sig¬ 
nificance, no significant differences are found between the 
two product systems. 

4 Uncertainty importance analysis 

Crystal Ball* is also equipped with a tool which calculates 
the uncertainty importance of each parameter. This tool cal¬ 
culates the uncertainty importance by computing rank cor¬ 
relation coefficients between every parameter uncertainty and 
every model outcome, such as the ACI, during the simula¬ 
tion. If a parameter and a model outcome have a high correla¬ 
tion coefficient, this means that the uncertainty in the param¬ 


eter has a relatively large impact on the uncertainty in the 
model outcome. In the current assessment, the relative contri¬ 
bution of each parameter uncertainty to the uncertainty of the 
Comparison Indicators is approximated by the square values 
of the rank correlation coefficients r normalized to 100%. Table 
7 lists the parameters which make a relatively large contribu¬ 
tion (> 5%) to the uncertainty of the GWCI |00 and ACI. In 
this respect, parameters which dominantly cause uncertainty 
in the ACI are of most interest, because statistically significant 
results are not obtained for the ACI as opposed to the GWCIs. 
Uncertainty in the ACI is almost entirely caused by uncertainty 
in the proton release due to NO x emissions, regardless of the 
allocation method used (—> Table 7). Research priority should 
in this case be given to reducing the uncertainty in the average 
removal of NOj‘ ions due to harvesting. 

If the main goal of the assessment is not to compare products 
but, for example, to find product improvement options, an 
uncertainty importance analysis, performed for each product 
system separately, will be relevant. Tables 8 and 9 show that 
other parameter uncertainties, such as uncertainty of the life¬ 
time of roof gutters, become important in the separate analy¬ 
ses. The partly changed relevance of parameter uncertainty is 
explained by the fact that some parameters are not specified 
per separate product system but are implemented only once in 
the simulation model. As a consequence, these parameters 
are mainly "divided out" in the product comparison, while 
in a separate analysis of the product systems they are not. 
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Tabic 7: Uncertainty importance of input parameters, expressed in percentage contribution to the output uncertainty, relevant (> 5%) for 
determining of the significance of differences between the product systems A1 and A2 for the GWCI 100 and the ACI 


Parameter 

Global Warming (lOOy) 

Acidification 


C a 

A b 

C“ 

A" 

Recycling fraction roof gutter A1 (-) 

23.4% 

14.7% 



Recycling fraction roof gutter A2 (-) 

26.6% 

12.6% 



Plastic PI input in production roof gutter A1 (kg) 

14.0% 




Plastic P2 input in production roof gutter A2 (kg) 

12.5% 




Mass of product A1 related to the functional unit of the receiving product 
system S (kg) 


13.2% 



Mass of product A2 related to the functional unit of the receiving product 
system S (kg) 


31.3% 



N ,0 emission in roof gutter A2 recycling process (kg) 

Proton release due to 1 mol NO x emission (mol) 

10.8% 


82.9% 

81.0% 

NO x emission in plastic P2 production (kg) 



6.7% 

6.6% 

Total uncertainty importance, explained by above factors 

87.3% 

71.8% 

89.6% 

87.6% 

'C = Cut-off allocation method; b A = Avoided-impacts allocation method 


Table 8: Uncertainty importance of input parameters, expressed in percentage contribution to the output uncertainty, relevant (> 5%) for 
determining the contribution to global warming (time horizon 100 years) and acidification of product system A1 


Parameter 

Global Warming (lOOy) 

Acidification 


C" 

A" 

C“ 

A° 

Lifetime of roof gutter A1 (years) 

73.9% 

45.1% 

68.2% 

66.2% 

Recycling fraction roof gutter A1 (-) 

5.4% 

12.9% 



Mass of product A1 related to the functional unit of the receiving product 
system S (kg) 


11.9% 



Mass of product B related to the functional unit of the receiving product 
system S (kg) 


12.1% 



Fraction of 100 m roof gutter, initially applied to a one-family house (-) 

7.7% 

5.0% 

6.8% 

6.7% 

Proton release due to 1 mol NO x emission (mol) 



9.1% 

11.5% 

S0 2 emission per MJ produced electricity (kg) 



7.3% 


Total uncertainty importance, explained by above factors 

87.0% 

87.0% 

91.4% 

84.4% 

0 C = Cut-off allocation method; b A = Avoided-impacts allocation method 


Table 9: Uncertainty importance of input parameters, expressed in percentage contribution to the output uncertainty, relevant (> 5%) for 
determining the contribution to global warming (time horizon 100 years) and acidification of product system A2 


Parameter 

Global Warming (lOOy) 

Acidification 


C a 

A b 

C a 

A° 

Lifetime of roof gutter A2 (years) 

69.1% 

30.4% 

23.0% 

21.3% 

Recycling fraction roof gutter A2 (-) 

6.5% 

7.2% 



Mass of product A2 related to the functional unit of the receiving product 
system S (kg) 


19.2% 



Mass of product B related to the functional unit of the receiving product 
system S (kg) 


18.9% 



Fraction of 100 m roof gutter, initially applied to a one-family house (-) 

N0 2 emission per kg material B production (kg) 

Proton release due to 1 mol NO x emission (mol) 

7.1% 

5.5% 

68.3% 

70.3% 

Total uncertainty importance, explained by above factors 

82.7% 

81.2% 

91.3% 

91.6% 

a C = Cut-off allocation method; D A = Avoided-impacts allocation method 
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5 Discussion 

As shown in this simplified example, the procedure to 
operationalise uncertainty due to choices and parameter 
uncertainty in LCAs is relatively straightforward. However, 
when "real-life" LCAs are analysed, feasibility problems will 
occur. It will probably not be feasible in LCA case studies to 
analyse the effect of all possible combinations of choices, to 
underpin the uncertainty ranges of all the input data used in 
the inventory, and to perform an extensive parameter uncer¬ 
tainty analysis in the characterisation phase. Options to deal 
with these problems are discussed below. 

When performing LCAs, choices are unavoidable. Aside from 
the choice how to allocate environmental burdens in open- 
loop recycling processes, several other choices will lead to 
uncertainty in LCA outcomes, such as the choice how to 
allocate environmental burdens in multi-output and multi¬ 
waste processes, and the choice of a functional unit. The 
following procedure, partly based on recommendations in 
Kortman et al. (1996), may help to decrease the number of 
choice combinations in LCA case studies: (1) formulate sev¬ 
eral options for every LCA choice; (2) find the two "ex¬ 
treme" options for every choice; (3) construct two "extreme" 
combinations of options and compute the effect of the two 
combinations on the LCA outcomes. 

Furthermore, in practice it will be very difficult to underpin 
the uncertainty ranges for the huge number of parameters 
involved in the inventory analysis. Focusing on key param¬ 
eter uncertainties will increase the feasibility of the uncer¬ 
tainty analysis and will decrease the validity of the uncer¬ 
tainty analysis only in a limited extent. Heijungs (1996) 
proposes to first perform a broad sensitivity analysis, using 
standard uncertainty estimates, to find out what parameters 
may contribute substantially to the uncertainty in environ¬ 
mental profiles. In a probabilistic simulation program it is 
possible to perform a sensitivity analysis in the same way as 
in the uncertainty importance analysis described in the pre¬ 
vious section. Each parameter is then characterised with the 
same percentile sensitivity range and distribution, for exam¬ 
ple i 10% of most likely numbers as a uniform distribution. 
The parameters which together cover 90% of the sensitivity 
range, for instance, should then get priority to find accurate 
measurements or better uncertainty estimates. However, a 
disadvantage of using one standard sensitivity range is that 
parameters which are initially thought to present a minor 
contribution to LCA outcomes, but has an expected large 
unknown uncertainty range, are thrown out of the analysis 
beforehand. A very rough solution is perhaps found in the 
use of a number of standard sensitivity ranges for types of 
environmental interventions, such as the application of sev¬ 
eral "uncertainty factors" in the roof gutter example used in 
this article. 

A complementary strategy to simplify the uncertainty analysis 
is to implement uncertainty ranges for accumulated envi¬ 
ronmental interventions rather than individual parameters 


in LCA inventories (see Kennedy et al., 1996). This simplifi¬ 
cation could be particularly useful in the analysis of the po¬ 
tential importance of background data in the uncertainty 
analysis. For example, ranges for accumulated emissions per 
MJ electricity use could be implemented in the sensitivity 
analysis. If it appears that some of the accumulated emis¬ 
sions may contribute substantially to the uncertainty in model 
outcomes, a reconstruction of parts of the inventory for elec¬ 
tricity production will be necessary. Moreover, a second sen¬ 
sitivity analysis could be performed to find the dominant 
parameter uncertainties in the computation of the most im¬ 
portant accumulated emissions. If potentially dominant pa¬ 
rameter uncertainties are found, more sophisticated meth¬ 
ods, such as the method described by Weidema & WesN/f.s 
(1996) combined with expert judgement, and measurement 
of inaccuracies may be used to estimate uncertainty ranges 
in derail. 

In addition to the lack of uncertainty estimates for process 
data in the inventory analysis, uncertainty pertinent to char¬ 
acterisation factors is generally unknown or very poorly 
known. An important difference between process data of 
the inventory and characterisation factors, however, is that 
process data are directly measured, while characterisation 
factors are computed with (simplified) environmental mod¬ 
els. Therefore, uncertainty ranges for characterisation fac¬ 
tors can only be found by a parameter uncertainty analysis 
within these models. Developers of characterisation factors 
should pay attention to this aspect, if necessary in co-opera¬ 
tion with environmental model experts. 

Finally, although operationalising the effect of parameter 
uncertainties and uncertainty due to choices is important, 
model uncertainties should not be disregarded. As pointed 
out in the introduction, model uncertainties, such as the lack 
of temporal and spatial variability in the assessment, have 
not been quantified in LCAs (Huijbregts, 1998). Because of 
these inherent model uncertainties, it is important to avoid the 
appearance that uncertainty in LCAs is totally quantified with 
the techniques used in this paper. Other analytical instruments 
are needed to deal with these model uncertainties. 
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